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Abstract 

The one-step rephca symmetry breaking cavity method is proposed as a new tool to 
investigate large deviations in random graph ensembles. The procedure hinges on a gen- 
eral connection between negative complexities and probabilities of rare samples in spin 
glass like models. This relation between large deviations and replica theory is explicited 
on different models where it is confronted to direct combinatorial calculations. 

PACS: 02.10.Ox - 05.50.+q - 75.10.Nr 

1 Introduction 

In systems with quenched disorder and not too long range interactions, the free energy 
density is a self-averaging quantity that converges, with probability one, to a typical value 
when the size of the system tends to infinity. The difficulty to compute such typical 
quantities is responsible for the tremendous activity observed during the last 25 years, 
and has motivated the introduction of two powerful tools, the replica method and, its 
equivalent reformulation, the cavity method [1]. Significant advances in the quest for 
setting these methods on firm mathematical grounds have been made recently, leading 
to the demonstration of a number of predictions of replica theory, but many challenging 
related problems are still open [2]. 

Initially restricted to models with quenched disorder defined on complete graphs, the 
replica and cavity methods have been extended in many different directions, including the 
study of metastable and non-equilibrium states, frustrated but non disordered systems, 
and models defined on dilute, finite connectivity, graphs. The progress has recently led, 
in the context of the cavity method [3], to predictions for different important and famous 
optimization problems, like k-sat or coloring. These results are conjectured to be exact 
[4], and in some cases, including most notably the random assignment problem, they have 
been confirmed by a rigorous proof [5]. 

In many optimization problems, part of the quenched disorder is encoded in an en- 
semble of random graphs [6]. A characteristic of random graphs is that, in the limit of 
infinite sizes, many of their properties, like for instance the existence of a percolating 
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structure, have a threshold behavior [7]: if a graph is randomly chosen from some prede- 
fined ensemble, it satisfies a given property, like percolation, with probability zero or with 
probability one, depending on the ensemble. When a property is satisfied asymptotically 
almost surely i.e., with probability one in the infinite size limit, we refer to the graphs 
having this property as the typical graphs for this property; the rest, having measure zero, 
arc rare, atypical, graphs. A change from zero to one for the probability of occurrence 
of a given property, when some parameter characterizing the ensemble is varied, is a ge- 
ometrical realization of a phase transition. This connection between statistical physics 
and graph theory has been recognized for along time; however, up to now it has been 
restricted to typical graphs. 

The object of this paper is to point out that the cavity method, initially developed 
to treat typical samples, can also provide valuable information on atypical samples and, 
in particular, on atypical graphs. Given a constrained satisfaction problem, a sample is 
said frustrated if it is impossible to satisfy all constraints, and otherwise unfrustrated. The 
quantity we will evaluate is the probability of typical, unfrustrated, samples in a regime 
where the problem is typically satisfiable. 

More precisely, we relate, for a given model, the central object of the cavity method, the 
complexity, to the rate function describing the large deviation probabilities of the ground 
state energy. The conjectured relation, stated in Eq. (5), is motivated by a general, yet 
heuristic, argument and is explicitly verified in a number of particular cases for which the 
complexity and large deviations properties can be computed independently. The examples 
treated include the random energy model (REM) [8], the it J spin- glass on a Bethe lattice 
[4] and a class of lattice glass models [9] , the most famous of which being the hard-core 
model. 

The connection between complexity and large deviations allows us, when the quenched 

disorder lies in the random graph structure, to extract some probabilities of atypical 
graphs from the cavity method. We show for instance how the study of the hard-core 
model provides us with the asymptotic probability for a random graph to be bipartite, 
that is, bicolorable. Such a result is particularly interesting considering the very small 
number of techniques available for studying atypical graphs. Remarkably, other though 
related statistical physics tools have also been shown, very recently, to give access to 
different atypical graph properties [10]. 

The paper is organized as follows. Random graphs, which will constitute the most 
interesting instance of quenched disorder, are introduced in Sec. 2, together with a dis- 
cussion of their relation to mean-field approximations. Sec. 3 presents, on the example of 
lattice glass models, the concept of complexity (also called configurational entropy) in the 
framework of the cavity method. Sec. 4 introduces the conjecture relating negative com- 
plexities to atypical samples. The proposed relation with large deviations is then exactly 
verified on the REM in Sec. 5, on the spin glass model in Sec. 6.1 and on the hard-core 
model in Sec. 6.2. For this later model, applications to graph theory are emphasized, and 
a generalization to more general lattice glass models is given in the appendix. The issue 
of the validity of the 1-RSB approach, which appears questionable for the spin glass and 
hard-core models, is addressed in Sec. 6.3. Finally, the conclusion suggests some potential 
implications. 
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2 Random graphs and Bethe lattices 



A random graph is a set of vertices with edges randomly connecting pairs of them. At fixed 
number N of vertices, different classes of random graphs can be defined, depending on the 
rule used to randomly construct the edges. For instance, having the N{N — l)/2 edges 
present with independent probability ^/N defines Erdos-Renyi random graphs, named in 
honor of the mathematicians who first introduced them in the 1960's [11]. These graphs 
have the property that, in the limit N ^ oo, the number of edges associated to a vertex, 
called the degree d of that vertex, obeys a Poissonian distribution, p^ = ^'^e~'^ /d\. In the 
last forty years, graph theory has been the object of much activity in probability theory 
(see e.g. Ref. [6] for an account), and it has found many applications in the study of real 
complex networks [12]. Recent investigations on the structure of social networks or the 
Internet have focused on classes of random graphs with different degree distributions, like 
for instance power-laws, pd oc d~'^ [13]. Another class consists in fixing the degree d to 

(r) 

be the same for all vertices i.e., p^ = Say-i tl^is defines the class, hereafter noted Q)^ of 
random r -regular graphs [14]. 

Due to their local homogeneity, random regular graphs are useful as approximations 
of (non random) regular lattices. The intrinsic difficulties of three-dimensional Euclidean 
lattices has indeed oriented attention on mean-field models where only local correlations 
are treated exactly. In turn, such mean-field models are often related to some particular 
graph (called lattice when non random) such that the approximation is exact for models 
defined on it; for instance the Curie- Weiss mean-field approximation, where all correlations 
are neglected, is associated with completely connected graphs i.e., lattices where every 
vertex is connected to all other vertices. 

A more refined mean-field approximation is the Bethe-Peierls approximation where 
nearest neighbor correlations are treated exactly while correlations at higher distances 
are self-consistently taken into account. In this case, people speak of the Bethe lattice as 
the structure on which the approximation is exact. Unfortunately, this structure is not 
independent of the particular model under consideration. While the interior of a Cayley 
tree is appropriate when dealing with unfrustated models such as the Ising model (see 
e.g. Ref. [15]), it is no longer adequate for frustrated models such as glass models, due 
to an oddly defined thermodynamical limit (see e.g. Ref. [16]). It has been proposed [17] 
that random regular graphs provides the suitable structure, valid both for unfrustated 
and frustrated system. Indeed, in the large A'^ limit {N being the number of vertices) a 
random regular graph is locally tree-like, but statistical physics models defined on it do 
not suffer from the strong boundary dependence that affects Cayley trees. 

One way to implement this idea is to study a problem of statistical physics on a 

(r) 

graph generated randomly with uniform distribution from the class Q)^ of random reg- 
ular graphs. This procedure actually amounts to introducing a quenched disorder whose 
distribution is defined by the ensemble of random graph; this quenched disorder can be 
handled by means of the cavity method [3]. 

3 The cavity method 

Atypical samples show up in the cavity method when computing the complexity, also 
called the configurational entropy. For definiteness, we present this concept and the cavity 
method on the example of lattice glass models where the quenched disorder is only coming 
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from the underlying spatial structure, which is taken to be a random regular graph (see 
Ref. [18] for more details on the cavity method). Lattice glass models aim at modeling 
the geometrical frustration that arises in three dimensional vitreous systems where the 
locally preferred structure, an icosahedron formed by one atom surrounded by 12 other 
atoms, is incompatible with the global constraint of tiling the entire space (this is due to 
the 5-fold rotational symmetry of icosahcdrons). 

Frustration means that some local constraints forbid a global optimum to be obtained 
as a sum of local optimizations. In lattice glass models, the local geometrical constraints 
are expressed as the impossibility, for a given particle, to have more than a prescribed 
number £ > of neighboring particles [9]. For instance, taking 1 = defines the hard-core 
model where a particle on a vertex forbids the presence of another particle on all the 
neighboring vertices. 

In the absence of frustration, the greatest achievable density pep, the close-packing 
density, is associated with a crystalline order. In the i = case, it is characterized by 
an alternation of occupied and empty vertices, empty sites never being adjacent, so that 
Pep = Pcryst = 1/2; on the contrary, frustration is present as soon as the underlying lattice 
has an odd cycle i.e., a loop with an odd number of vertices, in which case there must exist 
two neighboring empty vertices. Since odd cycles proliferate in typical random regular 
graphs, models with a i = constraint defined on random regular graphs are expected to 
have a close-packing density prcp lower than the crystalline density, prcp < Pcryst ("rep" 
stands for random close-packing). 

The cavity method allows one to evaluate prcp for lattice glass models on random 
r-regular graphs with different constraints i < r; these models are noted LG{k,i) with 
r = + 1 in the following. For some of the parameters k, i, the cavity method indicates 
that the phase space has a one-step replica symmetry breaking (1-RSb) structure [9, 16]. 
It means that the high density configurations are organized into distinct components, 
called states [1]. This glassy feature is to be contrasted with the replica symmetric (rs) 
structure of a liquid state, where the dominant configurations belong to an unique cluster 
of configurations {one state only). If there are many states which are themselves organized 
into greater clusters, it is referred as 2-RSB; more generally, a m-RSB structure corresponds 
to a hierarchy of m families of clusters contained in one another. The m ^ oo limiting 
structure, as arises for instance in the SK model [1], is said to have a full replica symmetry 
breaking (full-RSB) pattern. 

In the 1-RSB framework, a state a, which represents a cluster of configurations, is asso- 
ciated with a certain density p^, different states can have the same or different densities. 
The complexity Ti{p), also called configurational entropy in the context of glass theories, 
depends on this phase space organization and gives the number J\f{p) of states with a 
given density p, through the defining relation. 



An example of complexity curve as obtained from the cavity method is shown in Fig. 1. 
The complexity counts states in the same way that the entropy counts configurations; it 
is therefore natural to introduce a quantity corresponding to a free-energy, noted (j){y), 
defined by 



Afip) = exp[NJ:{p)]. 



(1) 
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Figure 1: Complexity curve, as obtained from the 1-RSB cavity method, for the LG{k = 2,£ = 1) 
model. It corresponds to Fig. 6 of Ref. [16] with only the stable part kept and all the negative part 
for p > Prep — 0.5757 represented. Note the terminal point of coordinates Poo = 3/5 = 0.6 and 
^oo = |ln2 — iln5~ —0.250, where the slope —y of the curve becomes infinite (see the difference of 
scale between the two axes). 



from which the density p and the complexity S can be deduced through the relations [19] 

s(y) = y'V(y)> 

p{y) = -dy[y(l){y)]. 

The parameter y, the counterpart of the (inverse) temperature, is also the slope of the 
complexity curve, y = —dT,/dp. In contrast to the usual temperature, y is not an external 
parameter and must be chosen self-consistently. Thus, one can argue that the random 
close-packing density prcp is given at the y = y* for which (j){y) is maximal [18]; it corre- 
sponds to p(y*) = Prcp and 5](y*) = S(prcp) = 0. The values of the complexity S(p) for 
P < Prcp (sec Fig. 1), are attributed to the presence of many metastable states, i.e. states 

a with Pa < Prcp- 



4 Complexity and large deviations 

As shown in Fig. 1, the negative part of the complexity curve, on which we will focus 
here, is instead associated with densities larger than Prcp- This feature is at first sight 
in contradiction both with the definition of the complexity, Eq. (1), which insures that 
S(p) > 0, and with the claim that prcp indeed corresponds to a maximum achievable 
density. This paradox is removed if M{p) = exp[7VS(p)] is considered as an average, over 

(r) 

the quenched disorder generated by the class of random graphs G G Gj^ , of the number of 
states Mg{p) = exp[A'^E(5(p)] for the model on one such graph G. By definition Sg(p) > 0, 
but, if 

= E ^oi,). (4) 

we can have S(p) < 0. Here, \Q^^\ is the total number of graphs in This happens 

for instance if Mg{p) = for almost all G G Q^^^ and Mg{p) > only for some atypical 
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graphs. Prom this viewpoint, negative complexities are attributed to atypical graphs, and, 
more generally, to atypical samples. 

Of particular interest is the point of the curve with extremal density, p = poo, (see 
Fig. 1), which corresponds to totally unfrustrated graphs, defined as the graphs able to 
support a crystalline structure yielding poo = Pcryst! in the example of LG(A;, ^ = 0) models, 

i(r) 

they correspond to graphs with no odd cycles. For these unfrustrated graphs, noted ^ V' 
no replica symmetry breaking is expected i.e., Mg{Poo) = 2 = o{N) for G G Q'^^ ■ Since 
l^'^-'l/l^j^^l gives the probability Pjv that a random graph in Q^^^ is non frustrated, we 
obtain a relation between the probability Pjv for a sample to be non frustrated and the 
extremal value of the complexity Sqo = limj^^oo 

lim llnPjv = Soo. (5) 

TV— >oo Dl 

This relation constitutes the main conjecture of that paper. It is valid when Soo < 0, 
which means that the system is typically frustrated (i.e., non satisfiable). 

As shown in Fig. 1, the extremal density p = poo is reached at the terminal point 
y — ^ oo of the complexity curve; we generically expect 

(t>{y) - -Poo ~ ~ (y^oo) (6) 

where poo = Prs is given by a replica symmetric approach. This point basically stems from 
the fact that replica symmetry ignores frustration, and therefore yields the close-packing 
density realized on unfrustrated graphs, poo = Pcryst! this will be explicitly verified on 
the models studied below. Note finally that if unfrustrated graphs can be viewed as ideal 
realizations of the interior of Cayley trees, they are obviously not suitable as Bethe lattices 
when frustration is intended to be taken into account. 

The cavity method and the interpretation of negative complexities, presented here on 
the example of lattice glass models, equally apply to other models where the quenched 
disorder may include more than just the graph structure, as for spin glass models, or may 
even not contain any spatial disorder at all, as for the REM. All these statements are 
confirmed below, where we compare for these two models, and for lattice glass models, 
the predictions of the 1-RSB cavity method with some direct evaluations of large deviation 
properties. 



5 Negative complexity of the REM 

The random energy model (REM) [8] is renowned for being the simplest model to exhibit 
a 1-RSB structure [20] and therefore constitutes a natural testing ground. In this model, 
the quenched disorder is directly encoded in the 2^ energy levels {Ei, . . . , E2N} which 
are independently taken from a Gaussian distribution 

Pn{E) = ^e-^ViV. (7) 

The AT-dependence is chosen so that the ground state is extensive, i.e., with a density 

eo = ^ mm{Ei, E2N} (8) 
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having a finite limit when N ^ oo. The complexity can directly be defined as the 
microcanonical entropy, through the relation 



2^p^r(iVe)^e^^(^), (9) 

leading to 5](e) = In 2 — e^. In the context of the cavity formalism, it is associated with the 
potential (f){y) = —{ln2)/y — y/A. The typical ground state eo = — \/ln2 is obtained for 
S(eo) = 0. Note that Eq. (9) is usually justified only when e > eo [8], but we consider here 
this relation for arbitrary e and we will be particularly interested in the interpretation of 
the range where e < cq. 

The REM is one of the few spin glass models for which large deviations can be exactly 
evaluated [21], thanks again to the independence of the energy levels. Thus the probability 
P(e) for eo to be e is 

2^-1 



(nOO \ / — i 

dE'pM{E')\ . (10) 



Using a saddle point approximation, we rewrite it in term of the complexity S(e) as 



P(e) ~ e^^^'^) 1 - ~ giVE(e)-exp(iVS(e))_ (^j) 

Hence, we are led to distinguish the case where S(eo) > 0, for which we have 

P(eo > e^) ~ e- «^p(^s(«o)) ^ (12) 
from the case where S(eo) < 0, for which we have instead 

P(eo < e^) ~ e^^(^o). (13) 

This last relation indicates that, in the solvable case of the REM, the whole negative 
branch of the complexity curve, and not only the extremal point (which is actually 
not defined here) , can exactly be identified with the rate function for the large deviations 
of the ground state energy. 



6 Extreme samples and the y ^ oo limit 

The next examples we consider are based on two archetypical models, the ± J spin glass 
and the hard-core model. In contrast with the REM, they are defined on non trivial 
structures, taken here as random regular graphs. For these systems, no rigorous nor 
conjectured exact expression is known for the ground state energy; furthermore, we are 
able to explicitly demonstrate a correspondence between negative complexity and large 
deviations only in the particular limit y ^ 00 where analytical calculations are amenable. 
For both models, we proceed in two steps, first presenting the prediction from the 1-RSB 
cavity method for the extremal complexity E^o = liuiy^oo '^{ij) and. second, comparing it 
with the independent computation of the probability of a corresponding rare event. We 
will find that the conjectured relation, Eq. (5), is indeed exactly verified in each case. 
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6.1 Spin glass model 



The Bethe spin glass model [3] is composed of spins Sj = ±1 located on the vertices of a 
{k + l)-regular graph and interacting through the Hamiltonian 

H = Y^ JijSiSj (14) 

where the couplings Jij are quenched variables independently chosen on each link {i,j) of 
the graph from the binomial distribution p{J) = [6{J — 1) + d{J + l)]/2. The model has 
thus two sources of quenched disorder: the random regular graph spatial structure, and 
the random interaction couplings. 

6.1.1 The cavity approach 

The cavity method at zero temperature in the context of the spin glass model has been 
presented in detail by Mezard and Parisi [4], and the y ^ oo limit of the potential is 
found by following the principle of their calculations. On (k + l)-regular random graphs, 
we obtain 

Hy) ^ + In 2 (y ^ oo). (15) 

Prom the analog of Eq. (6), 0(j/) ~ eoo — Soo/y, we extract Soo = —[{k — l)/2] In 2. The 
value eoo = —{k + l)/2 is the RS factorized value as expected, corresponding to a system 
with no frustration (all links contributing to -1 in the Hamiltonian). Note that in spite 
of the random distribution of the couplings, the system has no local disorder, and hence 
can be treated in a factorized framework where all sites of the lattice are assumed to be 
equivalent; this is because on a tree, the typical local structure of random graphs, one can 
always eliminate the disorder via a gauge transformation. 

The factorized 1-RSB Ansatz is nonetheless known to be incorrect [4] , but we shall see 
that it provides exact information on rare atypical unfrustrated samples. The intuitive 
reason is that such samples, having no frustration, do not require additional replica sym- 
metry breaking. This will be confirmed by the direct calculation to follow, and justified 
in more detail through the study of the stability with respect to further rsb, in Sec. 6.3. 

6.1.2 A combinatorial approach 

In Sec. 4, we claimed that Soo is related to the probability Pn that a given sample is non 
frustrated. We verify here that Eq. (5) indeed holds for the spin glass model by giving a 
direct evaluation of the probability P/v- 

By definition, non frustrated samples arc such that there exists a configuration {s^''^} 

of the spins with —1 = Jijsf^"^ Sj^^ for all i,j neighbors; such samples with J^j = —sf''^Sj^\ 
are called Mattis models. The total number of Mattis systems that can be defined on a 
graph of size is 2^, the number of spin configurations. Moreover, on a given {k + 1)- 
regular graph of size N. the total number of possible realizations for the {Jij} is 2^^ 
where L^v is the number of links, L]\[ = (k + l)N/2. Therefore the probability to obtain 
a non-frustrated Mattis system from a random choice of the couplings is 

Piv = 2^/2'^^ = e-^^i°^ (-^g) 
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Comparing with the expression for the extreme complexity, Soo = —[{k — l)/2]ln2, we 

verify that Pjv = e'^^°°, in agreement with Eq. (5). The result for Pjv actually holds 
for any given (fc + l)-regular graph, and therefore does not contain any information on 
atypical graphs. 



6.2 Hard-core model 

The hard-core model is another simple model where the interpretation of Sqo can be 
checked by purely combinatorial arguments. In addition, contains in this case in- 
formation on a atypical subset of the ensemble of random graphs on which the model is 
studied. Similar conclusions hold for more general lattice glass models and the general- 
ization is presented in the appendix. 



6.2.1 The cavity approach 

The hard-core model is the simplest lattice glass model LG(A;, ^ = 0); it has been considered 
previously on Erdos-Renyi graphs in Ref. [22] as a model equivalent to the optimization 
problem called minimum, vertex- covering (sec Rcf. [23] for a review) and is also referred as 
the independent set problem in the mathematical literature, it is. In spite on the simplicity 
of its definition (maximally pack particles subject to the constraint that no two particles 
can be neighbors), no exact information is known on the phase-space structure on typical 
random regular or Erdos-Renyi graphs; in fact, as for the spin glass model, this structure 
is conjectured to be of full-RSB type. 

The principle of cavity calculations in the context of lattice glasses are presented in 
detail in Ref. [16] for i > 1, and we only outline here the calculations for the i = case 
(see also Ref. [24]). Thus, following Ref. [16], the partition function Zi for a rooted-tree 
with root i is decomposed into a sum over two sets of configurations, Zi = zf^^ + 
where configurations with an empty root determine zf^^ and those with an occupied 
root determine Z^^ . A recursion in terms of the conditional partition functions of the 
neighbors j = 1, . . . , A; is easily obtained, 

i=i 



where /it is a chemical ■potential (z = e^ is sometimes called the activity) weighting vertices 
carrying a particle. The greater > is, the more occupied sites are favored; the close- 
packing limit corresponds to /x — ^ oo. A cavity field hi on site i can be defined as 

(18) 

M \zr+zrj 

It satisfies the recursion relation 

hi = h {{hj}j) = - In [l + e'^(^-^^- '^^) 1 . (19) 

/XL J 
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Because of the absence of quenched disorder and of the local homogeneity of random 

regular graphs, the RS solution corresponds to a liquid phase given by the fixed point 
of Eq. (19) with hi = h^q for all vertices i. In particular, for /i oo, one obtains 
h\iq l/(^ + 1)- This can be used to calculate densities [16], yielding Prs(M) ~^ 1/2 as 
— ^ oo. This value corresponds to a crystalline close-packing p^s = /^cryst and is certainly 
an overestimation of the random close-packing value Prcp, as already discussed in Sec. 3. 
In fact, the liquid solution can be shown to become unstable beyond a certain chemical 
potential yUc- 

The 1-RSB Ansatz provides a better approximation that takes into account some of 
the frustration effects by allowing the phase space to break into states i.e., clusters of 
configurations. In the /x — > oo limit, Eq. (19) becomes 



k 



hi = max 0, 1 - ^ h^j . (20) 



7 = 1 



The 1-RSB order parameter is then a distribution P{h) over cavity fields associated with 
different states that can be written as P{h) = p8{h) -I- (1 — p)5{h — 1). It is described by 
a single real p G [0, 1] which satisfies the self-consistent equation 



1 - / 



To obtain Prcpj parameter y must be chosen to maximize 0(y), here given by 

k + l 



m = -- 

y 



In (l + p''+\ey - 1)) - In (l + (1 - pf{e-y - 1)) 



(22) 



On the other hand, if one focuses on the y oo limit, one finds that p ^ e~ 

-y/ik+i) and 

</'(y)--^ + ^ln2 (y^oo). (23) 

Referring to Eq. (6), we read off poo = 1/2 and Eqo = — ^^ln2. As anticipated, we 
obtain p^o = Prs = Pcryst = 1/2, the maximum density on a graph with no frustrating 
loops. (This RS value is different from the non-factorized one that can be calculated at 
y = 0.) For i = 0, unfrustrated graphs are graphs with no odd cycles and are called 
bipartite or bicolorable graphs. 



6.2.2 A combinatorial approach 

According to Eq. (5), the complexity Eqo < is related to the probability for a random 
r-regular graph (r = A: -f- 1) to be bicolorable. In order to check this probabilistic interpre- 
tation of Soo, we present an independent derivation of the probability of non frustrated 
samples based on the asymptotic estimation of the probability PAr(r) = |/|^^^ | that a 
random r-regular admits poo = 1/2 as maximum density i.e., is bipartite. As in the cavity 
method, the idea is to study the system under addition of one vertex (in fact adding two 
vertices at a time turns out to be more appropriate). The idea is to compute A2(r) such 
that P;v+2(r) ~ A2(r)Pjv(r) (asymptotically in N), in order to write PN{r) ~ A2(r)^/^ 
and verify that we indeed have Soo = 5 In A2(r) i.e., e^^°° ~ PN{r) as predicted in Eq. (5). 
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Figure 2: Addition of two vertices to build a r-regular graph of size N + 2 from one of size N, 
illustrated here with r = A; + 1 = 3. First, r = 3 edges are chosen at random and cut. Second, two 
new vertices are connected to the 2r = 6 vertices left with one missing edge. 



P\ P\ ^ P\ ^ P\ P\ ^ !^ 



Figure 3: Addition of two vertices to build a r-regular bipartite graph of size N + 2 from one of size N. 
For a bipartite graph, each vertex can be colored either in white or in black, such that no identically 
colored vertices are adjacent. The r = 3 edges chosen at random to be cut thus necessarily connect 
two vertices with different colors. To obtain again a bipartite graph when adding two vertices, the 
two new vertices must be of different colors, and no choice is left to connect them to the old ones. 



To do so, we successively estimate the total number \Qj^ \ of random regular graph with 
size N and degree k + 1 = r, and the number of unfrustrated (bipartite) random 

regular graphs of size A^. For convenience, the graphs we count here are unlabelled graphs 
i.e., defined up to an isomorphism of the vertices, but, as discussed below, the distinction 
with labelled graphs, is actually irrelevant in the large N asymptotics. Firstly, to relate 

(r) \ \ (r) I 

|^]y I and |^]v+2l' construct a graph with A" + 2 vertices from one with N vertices. 
One way to add two vertices while preserving a constant degree r is to remove r edges 
and connect two new vertices to the 2r vertices having one edge removed, as shown in 
Fig. 2. The total number of edges is rA/2, so we have C{rN/2,r) choices when deciding 
the edges to cut, where C{n,p) = n\/[p\{n — p)\] denotes the binomial coefRcient giving 
the number of ways to partition n elements into groups of p. For the recombination, we 
have R{r,2) choices, where R{n,p) = {np)l/\pl{niy] corresponds to the number of ways 
to gather np objects into p indiscernible packs of n each. This way, all random regular 
graphs with A + 2 vertices are constructed from those with A. However, we did some 
overcounting: each graph with N + 2 vertices can be obtained from a certain number of 
different graphs of size A^. To evaluate that number, we consider a graph with A^ + 2 
vertices: any pair of vertices can correspond to the two newly added vertices, and there 
are C(A + 2,2) such pairs. Given a pair of vertices, the graph can result from R{2,r) 
different graphs of size A: they are found by deleting the edges of the pair of vertices and 
recombining in all the possible ways the vertices left with one missing edge. Finally, we 

ICW I C{rN/2,r)R{r,2) (,) 

l^^+^l ~ C(A + 2,2)i?(2,r)'^^ I" ^^^^ 
This is only asymptotically correct, since we tacitly assumed for instance that two edges 

, ,(r), I i(r] I 

picked at random do not share a common vertex. Next, we relate \Q )^ \ and |^ 7v_,_2l 
by starting from a bipartite graph of size N and by constructing one of size AT + 2. 
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By definition, it is possible to color each vertex in white (empty) or black (occupied by 
a particle), with no edge between two vertices sharing the same color. If we add two 
vertices, there must necessarily be one white and one black. Again, deleting r edges can 
be done in C{rN/2, r) ways, but this time there is only one way to connect the two new 
vertices with the old ones (see Fig. 3). To evaluate the degeneracy, we have to consider 
one of the [(A^ + 2)/2]^ pairs of white and black vertices and count the number of ways to 
reobtain a bipartite graph of size if they are removed: since we are left with r vertices 
of each color, this number is r!, the number of mappings from the white to the black 
vertices. Thus, we get 

,/(r-) I C{rN/2,r) ^^,ir), 
[{N + 2)/2fr\ 



We are then in position to calculate 

Mr) - = - ^-C^-) = 2-(^-), (26) 

in agreement with our expectations since it yields = |lnA2. The complexity Soo 
thus indeed gives the probability Pjsi ~ 2~^(''/^~-'^) for a random r-regular graph to be 
bipartite. 

6.2.3 Connections with graph theory 

Interestingly, Eq. (24) also gives an estimation of the total number of unlabelled random 
regular graphs, a quantity which, in contrast to the case of the Erdos-Renyi class, is 
not straightforwardly obtained [6]. We calculated indeed |^jj-+2l/l^7J''*l ~ r^A''^~^/(r!)^ = 
Kr{N), therefore 



N 



n=l ^ ^ 

This can be compared to known mathematical results. The mathematical literature is 
mostly concerned with labelled random graphs, having distinguishable vertices. However, 
since the automorphism group of a random graph is in fact typically trivial [6] , the num- 
ber of unlabelled graphs can be obtained from the number of labelled graphs merely by 
dividing with N\. Thus, the number Ur{N) of unlabelled regular graphs is known to 
satisfy [6, 14], 

1^^' I ~ (riV/2)!2'-^/2(r!)^iV! ^ ^^^^ 

Formulae (27) and (28) are asymptotically equivalent, in the sense that lnUr{N) = 
lnVr{N) + o{N). In Eq. (28), the precise factor e'^''^-^)/^ reflects the fact that Ur{N) 
includes only simple graphs i.e., graphs with no loop of size one or multiple edges [14], 
a detail inaccessible to the too crude asymptotic estimations of the cavity method. Sim- 
ilarly, the number of bipartite graphs as estimated from Eq. (25) is consistent with an 
asymptotic estimation, due to O'Neil [25], of the number of bicolorable labelled r-regular 
on N vertices [14], 

(rA^/2)!e-(^-^)'/^ 
"(Hp 



BAN) = . (29) 
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Here again, the number of unlabelled bipartite graphs can be obtained by dividing Eq. (29) 
with the expected number Ar{N) of automorphisms of labelled bipartite r-regular graphs 
of size [14]. Since the labelling of a bipartite graph is 1,2, ... , N/2 for the vertices of 
each color, one has to use Aj.{N) = to verify that Eqs. (25) and (29) are indeed 

consistent. If the same labelling is kept for bipartite and non-bipartite graphs, the trivi- 
ality of the automorphism groups indicates that the asymptotic probability PAr(r) can be 
indifferently obtained as a ratio of labelled or unlabelled graphs. Therefore, the distinc- 
tion between distinguishable and indistinguishable vertices, while crucial when counting 
small graphs, is irrelevant in the asymptotic regime where the cavity method operates. 
Coming back to atypical graphs, we already noted that the cavity method on hard-core 
models yields the probability for a random r-regular graph {r = k + 1) to be bicolorable, 

Pjv(r) ~ 2-(i-^)^. (30) 

Similar conclusions should apply to other random graph ensembles; thus for Erdos-Renyi 
graphs with mean-connectivity 7, the result of Zhou [24], Sco = — 7r^(ln7 — 1)^/167, can 
be used to infer 

Pjv(7) ~ e ^ ^. (31) 

Note that this relation holds only for 7 > e, since low connectivities 7 < e correspond here 
to a RS regime where graphs arc typically i.e., asymptotically alm,ost surely, bicolorable, 
that is -Piv(7 < e) = 1. Other ensembles on which the hard-core model has been studied 
include random graphs with arbitrary degree distribution [26] and random graphs with 
short local loops [27]. 



6.3 Validity of the 1-RSB approach 

The previous discussion resorted to a 1-RSB Ansatz which is known to be wrong for the 
spin glass model [3], and to correctly describe LG{k,i) models only for a restricted set of 
the parameters i and k, as discussed in Ref. [16] for i > 1. In general, a 1-RSB Ansatz 
can undergo two kinds of instabilities [28]: one of a first kind for y > yi^^ and of a second 
kind for y < For the LG(A;,^ = 0) models, one finds y* < y^^ < yi^^ if k = 2, in 

which case only a restricted negative part of the complexity curve is stable, while for all 
other values of A; > 3 studied, yl^^ < y^^ and no part of the complexity curve is stable to 
further breaking of the replica symmetry. Therefore, in the case of the hard-core model 
too, our conclusions based on 1-rsb calculations are questionable. In this respect, the 
observed agreement, for all models studied, between the 1-RSB complexity at infinite y 
and the independent counting arguments looks quite puzzling. 

This suggests that the 1-rsb approximation in fact provides exact predictions in the 
y — 00 limit, thus generalizing the observation that the RS approximation also carries 
exact information on this limit, in the sense that ^(y = 00) = —poo = —Pis- We therefore 
propose that the 1-RSB complexity Eqo gives the exact first correction to an expansion of 
a full-RSB potential (p^°°^ around its minimum i.e., (i>^^\y) = —Poo — '^oo/u + 0{l/y) for 
y — 00 with Soo obtained from the 1-RSB approximation. 

To check this point explicitly, we consider the stability of the 1-RSB Ansatz in the 
framework of 2-RSB cavity equations. For sake of concreteness, we restrict ourselves 
to LG(fc,£ = 0) models, but the conclusions should hold for more general models. In 
this context, the order parameter is a distribution Q[P] over cavity field distributions 
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Pa{h) which are in fact described, as noted in Sec. 6.2, with a single real Pa such that 
Pa{h) = PaS{h) + (1 — Pa) ^{h — 1). The cavity equation at the 2-RSB level reads 

k / \ / k \ ^^^^^ 

(32) 

with yi < y2, where y2 is associated with the smaller clusters, the states, and yi with 
the larger clusters, the families of states. Equation (32) admits as an exact solution the 
peaked distribution Q{p) = q6{p — l) + {l — q)5{p). It corresponds in fact to the embedding 
of the 1-RSB Ansatz into a 2-rsb framework, which is always possible. More precisely, 
this solution satisfies the analog of Eq. (21) with q and yi respectively playing the role of 
the 1-RSB parameters p and y (and y2 playing no role). 

Let us now consider the expansion of the 2-RSB potential ^^^^(2/1,^/2) around its mini- 
mum — Poo) reached for yi = y2 = 00. The first correcting term is expected to come from 
7/1, since yi <y2- As 7/2 is increased, one can see from Eq. (32), that Q get peaked on the 
integers and 1 and for y2 ^ co \s compelled to reproduce a 1-RSB solution (that can be 
checked numerically by population dynamics). This means that 4>^'^\yi,y2 = 00) = (f){yi) 
is given by the 1-RSB Ansatz. We limited ourselves here to 2-RSB, but by virtue of the 
recursiveness of the RSB scheme, the same feature repeats itself at each successive level 
of the hierarchy, yielding <f>^'^\yi,y2 = 00, . . . ,ym = 00) = (l)^^\yi) = (t>{yi) for arbitrary 
m > 1. This entails that Sqo as computed within a 1-RSB framework indeed corresponds 
to the first correction in 1/yi of the m-RSB potential ^^^^ in the vicinity of its minimum 
— P005 and, by extension to m — 00, of the full-RSB potential 

In the case of the spin glass or the LG(/c,£ = 0) hard-core models, deviations from 1- 
RSB predictions are expected as soon as y is finite, since the 1-RSB Ansatz is then unstable 
while, in more favorable cases, such as for instance 1 = 1 and /c = 2, 3, the whole negative 
part of the complexity curve is correctly described by an 1-RSB Ansatz [16] . 

7 Conclusion 

The negative branch of the complexity curve as obtained from the cavity method is usu- 
ally disregarded as an irrelevant, unphysical feature. We argued here that its extremal 
value, Soo, is related to large deviation properties of the disorder realization, i.e., to the 
exponentially small (with respect to the size of the system) probabilities of observing 
atypical samples. We explicitly checked this relation in several particular cases where 
exact computations could be done. 

As an application, we showed that when the quenched disorder lies in random graph 
spatial structure, 1-RSB calculations provide an efficient tool to evaluate asymptotic prob- 
abilities of atypical graphs. The simplicity of the method can be appreciated when com- 
paring it to equivalent combinatorial computations. These combinatorial arguments are 
however interesting not only because they validate the proposed interpretation, but also 
because they constitute a new situation where 1-RSB predictions are confronted with al- 
ternative derivations. 

The focus was mainly put on models defined on random regular graphs, but the same 
principles are expected to apply without additional difficulties to any other model defined 
on arbitrary ensembles of random dilute graphs for which Soo < 0. This includes notably 
various optimization problems on Erdos-Renyi (hyper)graphs where cavity calculations are 



14 



already available [29, 30, 24]. In this context, recognizing that large deviation properties 
can be obtained from well known statistical physics techniques could be a first step toward 
a reconciliation between the worst-case (atypical) viewpoint of computer scientists and 
the typical-case viewpoint on which most of "equilibrium" physics have focused up to now. 

Finally, besides these potential applications to random graphs or optimization prob- 
lems, wc note that large deviations arc already known to be deeply connected to statistical 
mechanics, and, more specifically, to the concept of entropy [31]. This work suggests that 
replica theory is also intimately related to the large deviations of the free energy with 
respect to a quenched disorder. The open problem of extending the present approach to 
the computation of the whole free energy probability distribution function beyond the 
extremal case of totally non frustrated samples may unravel additional connections with 
replica theory. 
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A Appendix: Lattice glass models 

This appendix is devoted to the extension of the methods and results of Sec. 6.2 on the 
hard-core model to lattice glass models with £ > 0. It leads to further support in favor of 
the interpretations of poo and Eqo, and to some additional results on atypical graphs. 

A.l The cavity approach 

The y ^ oo limit for the 1-RSB solution of LG(fe,^) models in the close-packing limit 
(/X — ^ oo) yields 



k + 1 
P^-2k-£-{-2 

h — -\ — kf — ^ 

E^=-—ln{2k-e + 2) + ^j—j-^ln(k-e+l) (33) 



2 2A;-^ + 2 2A;-^ + 2 V^K^-^)' 

As before, poo is indeed the (factorized) RS value, poo = Prs- The correspondence with 
the close-packing density on unfrustrated graphs can independently be demonstrated by 
building up a crystal in the following way: we start on a vertex and assume that no loop 
prevents us from choosing the best possible children at each successive generation. Noting 
'0' when a vertex is empty,' 1' when it is occupied but its ancestor is empty and '2' when 
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12 3 

Figure 4: Pictorial representation of the rules (34) used to determine Poo in LG(A;,£) models, here for 
k = 2 and £ = 1. The state of a vertex at generation t + 1 is determined by the state of its parent 
at generation t. If the parent is empty (noted '0' in the text and colored in white in the figure), 
its children are filled with a particle; they define the state '1' (in black) of occupied vertices with 
an empty parent. Such states generate children in state '2' (in grey), which are occupied vertices 
with an occupied parent too. Due to the constraint £ = 1, they cannot have occupied children and 
generate therefore empty vertices (state 0). The resulting population dynamics is described by the 
rate equations (35). 

both it and its ancestor are occupied, the rule, as illustrated in Fig. 4, reads 

0^1 + ... + !, 



(34) 



One deduces the number iV, of sites of each kind z = 0, 1, 2 at generation t+1 from that 
numbers at generation t: 

No{t +l) = {k- e)Ni{t) + {k-£ + l)N2it), 

Ni{t+l) = kNo{t), (35) 
N2{t + 1) = £Ni{t) + {£- l)N2{t). 

Fixed points of the form xi = Ni/Nq and X2 = N2/NQ are found to satisfy the equation 
Xi + {k—£)xi + {£— l)xi — k = whose only positive root is xi = 1, giving X2 = £/{k—l+l) 
and 

^ X1 + X2 ^ k + l 
^~ l + xi + X2~ 2k-£ + 2' ^ ' 

which coincides as expected with the Pco given by Eq. (33). 

A. 2 Combinatorial approach 

Here again < can be derived by purely combinatorial means, and we present such 
calculations for the case £ = 1. In this context {£ = 1), the final result can be interpreted 
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as the probability that a (A; + l)-regular graph has a close-packing of dimers, where dimers 
lie on the edges and exclude the neighboring and next-neighboring edges to be occupied. 
More generally, Pjv = exp[A''S(x,] represents the probability that a random (A;-|- l)-regular 
graph can support the extremal density poo, which means for general £ that it is possible 
to assign particles on some of the vertices such that each vertex is either empty with k + 1 
occupied neighbors, or occupied with exactly i occupied neighbors. 

The calculation follows the same principles as the one exposed in Sec. 6.2 for the i = 
constraint. Unfrustrated graphs here correspond to graphs where each vertex either is 
occupied with exactly one neighbors or is empty with r = k + 1 occupied neighbors. To 
keep the maximal density = (k + I)/ (2k + 1), it is here necessary to add at each step 
a number of vertices which is a multiple of 2k + 1; since on the other hand this number 
has to be even for the construction to be doable, we add 2{2k + 1) vertices at a time. The 
generalization of Eq. (24) for the addition of 2p instead of only 2 vertices (with in view 
p = 2k + l) is 

|g^?+2pl C(YiV,p(fc + l))i?(fc + l,2p) 

CiN + 2p,2p)R{2,p{k + l)) ^ ^ 

where, as before, the calculations are done for unlabelled graphs, and we note C{n,p) = 
n\/[p\{n — p)\], R{n,p) = {np)\/[p\{n\y]. The hard part is to relate the number of un- 
frustrated graph l^'^!j!2(2jk+i)l sizeA^ -|- 2{2k + 1) to that of size N. Starting from an 
unfrustrated graph of size N, we can distinguish empty vertices, of density po = k/ {2k+l), 
and occupied vertices, of density pi = (A; -|- 1)/(2A; -|- 1). We also need to consider the 
two kinds of edges, those relating one empty and one occupied vertex (edges of "type 1"), 
whose density is vri = 2k/{2k + l) and those relating two occupied vertices (edges of "type 
2"), whose density is 7r2 = l/{2k + 1). Among the 2{2k + 1) vertices added, 2{k + 1) must 
be occupied and 2k empty for poo to be maintained. If we want to be able to connect 
them to preexisting vertices with one removed edges, the edges to delete must be chosen 
carefully: it can be seen that we have to delete exactly 2k{k + 1) edges of type 1 and 
{k + 1) of type 2. Since there a total number of TriN{k + l)/2 edges of each type i = 1,2, 
the number Ai{k,N) of admissible choices for the edge deletion is 

Ai{k, N)=C {^iN{k + l)/2, 2k{k + 1)) C {TT2N{k + l)/2, k + I) . (38) 

To connect the new vertices, we have R{k + 1, 2k) choices for the new empty vertices, and 
[2{k + l)]lR{k,2{k + 1)) choices the new occupied ones ; the total number of choices is 
therefore 

A2{k, N) = [2{k + l)]\R{k, 2{k + l))R{k + 1, 2A;). (39) 

Now we evaluate the degeneracy of the construction, that is the number of graphs of size 
N leading to the same graph of size N + 2{2k + 1). As in the i = case, we do so by 
starting from an unfrustrated graph of size -|- 2(2A; -|- 1) and counting the number of 
unfrustrated graphs of size N obtained by deleting 2(2A; -|- 1) vertices. Here again, the 
choice of the vertices to remove is constrained: we have to delete 2(A;-|- 1) occupied vertices 
out of the pi [N + 2{2k + 1)] ones, and 2k empty vertices out of the po[N + 2{2k + 1)] ones, 
resulting in a number of choices 

A3{k,N) = C{pi[N + 2{2k + 1)), 2{k + 1))C{pq[N + 2(2A; + l)),2k). (40) 

Finally, we need the number of ways A4,{k, N) to add edges to reform an unfrustrated 
regular graph of size N. The 2{k + 1) occupied vertices left without neighbor must be 
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recombined together, giving a factor R{2, k + 1) while the 2k{k + 1) occupied ones with 
already one neighbor must be matched with the 2k{k + l) empty vertices, yielding a factor 
[2A;(fe + l)]!, so that 

Ai{k,N) = [2k{k + l)]\R{2,k + l). (41) 



This leads to the relation 

/(fc+i) 



|giv+2(2fc+i)l Ai{k,N)A2{k,N) 
~ As{k,N)A^{k,N) 

from which one deduces an asymptotical estimation of 



1 /AT\- ^N+2{2k+l) _ \y N+2(2k+l)\ 

^2(2k+i){]^) = ^ - -(FTT^ -— 

I^Ar+2(2fe+l)l |y N 



The result obtained is 



(42) 



5^ In A,(,,,,) (^^) - ^ In ^ - ^ + 1) = ^oo (44) 
in precise agreement with the interpretation of Sqo given in the text. 
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